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1,  Introduction*  ^  .Lj  j  -  ''  "<-6  A 

The  Ron ding  and  Vocabulary  part  of  tho  Basic  Classification  Battery 
was  developed  with  the  assumption  that  its  value  would  bo  on  lancet  y  -  - 
use  of  paragraphs  dealing  with  topics  of  intrinsic  interest  to  the >  .non, 

?h0  application  of  this  assumption  took  tho  direction  oi  Boalinf  mth 
rather  goner a 1  topics.  This  gave  rise  to  the  hypothesis  that  too  many^  ^ 
men  would  bo  able  to  answer  tho  questions  without  rocouroo  t j  ~ 

paragraphs.  Since  tho  Basic  Classification  Battory  is  an  at  temp 
minimize  the  dogroo  of  overlap  botwoon  Classification  '0S  .  n  A ' 

of  tho  dogroo  to  which  porformanco  on  this  tost  was  indopondon 
skills  needed  in  reading  tho  basic  paragraphs  is  important  to  answ  „ 

In  order  to  test  tho  hypothesis  that  general  information  could  play 
lar,0  role  in  porformanco  on  this  tost,  it  was  decided  to  administc. 

the  questions  to  a  group  of  men  without  giving  thomthu ^uity^tS 
X.U.,  hAo-i0  mragraphs.  Bocauso  of  convonionco  and  availability,  tno 

Enlistod  Classification  School  at  Washington  and  Jefferson  College  was. 
ohoson  as  tho  locale  for  the  collection  of  tho  experimental  data.  Tho 
fact  that  tho  minimum  General  Classification  Tost  score  for  qualification 
for  this  school  is  100  meant  that  tho  population  would  roprosent  tho  upper 
half  of  the  raigo  of  talent  in  tho  army.  This  was  not  too  serious  a 
deficiency  for  the  purposos  of  tho  study  bocauso  tho  bottom  half  ox 
range  would  very  likely  havo  difficulty  in  comprehending  and  accoptxng 
the  experimental  conditions. 

Tho  items  used  in  this  study  (approximately  500 )  chosen  from 

the  original  draft  of  the  tost,  comprising  approximately  4o0  items,  iho 
items  eliminated  were  those  that  soorned  least  susceptible  of  ^  ™s;rcr°d 
without  tho  paragraph.  The  tost  was  altered  to  conform  mth  th.  ch.ngo 
of  conditions,  e.g.  many  ox.  wiu  awwuwJuo  1  D 

wore  removed* 


2.  ■  | Purpose , 

ViThis  studv  was  designed  to  tost  the  hypothesis  that  without  opportunity 
to  ro°d  the  basic  paragraphs,  tho  altorriativo  answers  to  the  questions  m 
the  Reading  and  Vocabulary  Test  mil  be  chosen  in  chance  fashion^ 


Approximately  220  enlistod  men  of  tho  Enlisted  Classification  School 
wore  given  tho  tost.  Tho  distribution  of  'this  group  with  respect  to  GCT 
Army  grado  was  approximately  80  Grado  1,  80  Grado  II,  and  rn  e 
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Due  to  certain  Sr^^teS^^-e^qSertr^ 

^ss^st*  r^r*:  "L\^ s  ^  « -f"  ^T. 

army  grade  in  the  following  fashion;  64  Grado  I,  86  Grade  .  J  appr orimately 

The  men  in  this  group  were  virtually  all  hxgh  echo  f ^  ^  the  school 

half  had  taken  at  1™*  ^.iFibati^oouaur^  rather  than  in 

oonsj-a tod  primarily  o  ,  .  t  ^ _  r,ssumod  that  this  group  has 

psychological  tost  theory.  Ho»vor,  it  must  bo  , “  "Toloriccl  theory  than 
more  knowledge  ralating:to  classification  and^to  PJ^logioal  [• 

would  bo  found  in  a  group  representative  of  th m  as «l olo-  ^ 
will  modify  the  interpretation  oi  those  items  dealing  viun 

psychological  data.  •  ; 

4.  Results. 

'item  counts  on  all  four  alternatives  woro  m do  by  . Army  grade.  Si nco  the 

In  making  up' of  distribution  of  the  percent  choosing  tho  correct  alternative 
for  each  itomt  it  was  doomed  desirable  to  break  down  the  distribution  g 

to  typo  of  item.  The  following  system  of  classification  was  used: 

Tho  right  answer  depends  upon  identifying: 

1.  A  fact  or  idea  stated  in  tho  paragraph. 

2.  A  fact  or  idoa  not  stated  in  tho  paragraph. 

3.  A  fact  or  idoa  impliod  in  the  paragraph. 

4.  A  fact  or  idea  not  implied  in  tho  paragraph. 

5.  A  summary  statement  of  the  paragraph*  ,  . .  n 

6.  Correct  classification  of  a  series  of  statements  based  on  the 
paragraph.  Tho  type  of  classification  used  varied'  from  sori 
to  series,  o.g.  in  one  it  would  bo  a  classification  of-fcruth  or 
falsity  of  tho  statements,  in  hnothcr  it  would  bo  a  classifi 
tion  of  dogroo  of  implication  of  tho  statomont  by  tho  paragraph. 

■Thus  this  is  a  hotorogonoous  grouping.  nf  !+nm 

7.  A  corroat  interpretation  of  a  givon  statomont.  This  typo  of  item 

differed  from  typo  3  in  onus  one  “““  . 

not  dopending  upon  tho  paragraph  for  interpretation. 

8.  A  correct  synonym  for  a  givon  word  or  phrase.  y 

usago  of  tho  word  in  tho  paragraph  gave  it  a  different 

usual  interpretation.  , 

9.  Tho  oorroot  order  in  which  n  sorios  of  statements  appeared  in 

tho  paragraph.  '  •" 


TABLE  I 


FREQUENCY  DISTRIBUTION  OF  PERCENTS  ANSWERING  ITEMS  CORRECTLY  IN 

TERMS  OF  CLASSIFICATION  OF  ITEMS 


4 

Porcont  _ _ 

Corroct  " 

1  2 


90-99 

80-89 

14 

11 

1 

70-79 

3 

1 

60-69 

13 

2 

50-59 

14 

1 

40-49 

12 

3 

30-39 

18 

3 

20-29 

20 

1 

10-19 

12 

6 

0-9 

3 

Itom  Classifi option 


TOTAL 


3  4  5  6 


1 

2  I 

5  13  4 

3  112 

5  6  2 

2  4  3  3 

12  5  6 

3  16  4 

1  5  5 

2  1 


7  8 _ 9 


1  16 

3  16 

2  9  28 

1  8  31 

8  36 

8  35 

8  1  44 

1  6  42 

7  36 

a  10 


Total 


120 


18 


23 


31 


28 


62 


296 


Table  I  presents  the  distribution  of  the  porconts  correct  on  the.  items 
according  to  the  typo  of  itom.  If  the  alternatives  wore  chosen  by  ennnoo, 
25  porcont  would  bo  expected  to  chooso  the  right  alternative.  By  the  usu-1 
formula  tho  standard  error  of  this  porcont  would  be  .033  and  any  diiforonco 
greater  than  10  percent  points  would- bo  significant,  ns  a  crudo  os  m 
wo  might  say  that  any  percent  correct  of  60  and  above  would  most  lilc  y 
be  d^  to  chance,  that  percents  corroct  between  40  and  60  would  represent  a 
doubtful  area  of  significance  in  deviation  from  chance  expectation,  P^00^ 
corroct  between  20  and  40  would  very  likely  represent  chance  variations,  and 
percents  correct  botwoon  0-20  would  represent  a  rather  crudely  defined 
of  significant  variation  below  charco  expectation. 


On  the  basis  of  this  reasoning,  it  can 
tho  items  could  unquestionably  be  -answered 
that  still  another  third  might  also  bo  cons 
roctly  above  chanco  expectation.  About  one 
boon  answered  incorrectly, more  than  chanco 
itoms  may  bo  presumed  to  be  tho  best  items 
the  basic  paragraphs  will  cause  a  definite 
native. 


be  soon  that  almost  a  third  of 
correctly  without-  guessing  and 
idorod  to  have  boon  answered  cor- 
sixth  of  tho  itoms  seom  to  have 
expectation  would  allow.  Those 
in  the' test  sinco  tho  removal  of 
tendency  to  chooso  a  wrong  altor- 


TABLE  II 


COMPARISON' OF  ACTUAL  DISTRIBUTION  OF  PERCENTS  CORRECT  UITH 
DISTRIBUTION  EXPECTED  ON  ASSUMPTION  OF  INDEPENDENCE,  INCLUDING 

CHI -SQUARE  VALUES 


Item  Classification 


Corroct 

1 

2 

3 

5 

Actual 

41 

4 

11 

4 

7 

60-99 

Expoctod 

37.71 

5.66 

7.23 

9 .74 

8.17 

Chi-Squaro 

0,29 

0.49 

1.97 

<5%  38 

0§17 

Actual 

26 

4 

7 

9 

9 

40-59 

Expoctod 

30.43 

4.56 

5.83 

7.06 

6.59 

Chi-Squaro 

0.64 

0.07 

0.21 

0.17 

U.bB 

Actual 

38  . 

k 

4  ' 

11 

9 

20-39 

Expoctod 

34.29 

5.14 

6.57 

8,86 

7  #43 

Chi-Squaro 

0.40 

f 

0,25 

1.01 

0.52 

•0  •  o3.. 

Actual-- 

15 

6 

1 

7 

i 

0-19 

Expoctod 

17.57 

2.64 

3.37 

4.54 

3.81 

Chi- Squaro 

0.38 

4.28+ 

1.67 

1.33 

2.07 

Total , 

Chi-Square 

1.71 

5.09 

4,06 

5,40 

3  .45 

*  This  value  is  tho 

only  one 

in  tho  tablo  to 

which  any 

sign; 

b.o 

attached.  It 

has' a  probability 

of  occurronco  by 

chanci 

8 


21 

19.49 

0.12 

16 

15.72 

0.00 

14 

17.71 

0,78 

11 

9,08 

0.41 

1.31  21.82 


2' and  E  porcont. 


Table  II  shows  tho  results  of  the  chi-squaro  tost  of  the  independence  of 
the  distribution  of  item  difficulty  and  types  of  items*  Two  aspects  of  this 
table  should  bo  explained.  First  typo  4,  7  and  .9  wro  not  includod  because  _ 
those  woro  not  roprospntod  w  ith  sufficient  frequency.  Socond,  tho  toloscopmg 
of  "tho  data  into  tho  four  groupings  of  porcont  correct,  while  concoaling  somo 
of  tho  facts  was  nooossarv  in  order  to  prevent  too  many  cells  with  zero  or  near 
zero  ontrios. 

'  As  this  table  indicates,  thoro  was  a  dofinito  tondoncy  for  tho  distribu- 
tions  to  show  an  ovorall  indopondonce •  In  only  one  cell  was  there  any  dofinito 
tondoncy  to  deviate  from  chance  expectation.  This  was  tho  case . whore . a  greater 
number  of  men  thon  oxpoctod  by  chance  answered  incorrectly  tho  itoms  involving 
an  identification  of  a  fact,  or  idea  not  contained  in  tho  paragraph  (typo  2).  \ 
Bordering  on  reliability  was  tho  tondoncy  for  less  men  than  expected  to  seloct 
tho  correct  summary  statement  (typo  5)  with  a  frequency  equivalent  to' tho 
60-99  porcont  correct  area. 


r 


Although  conconlod  in  Table  II,  attention  should  be  calico  to  tnc  fact 
indicated  in  Tablo  I  that  virtually  all  of  the  items  answered  correctly  by 
90  percent  or  more  of  the  man  wore  of  tho  typo  involving  an  identification  o 
a  fact  or  idoa  stated  in  tho  paragraph  (typo  l). 


5.  Discussion* 

From  tho  ovidonco  prosontod,  thoro  seoms  little  doubt  that  the  materials 
in  this  tost  are  of  such  a  naturo  as  to  make  them  suscoptiblo  of  being  .msi.orcc 
corroctly  (without  recourse  to  tho  roading  materials)  by  the  upper  hal  o  0 
rango  of  talent.  Sinco  tho  tost  attempts  to  socuro  a  direct  mcasuro  of  roacmg 
skills,  this  is  an  aspect  of  tho  tost  which  should  bo  minimized.  Failure  to 
do  this  may  load  to  an  undosirablo  dogroo  of  intorcorrolation  with  other  es 
in  tho  battory.  In  addition,  it  is  probable  that  tho  tost  would  prove  too  easy 
for  tho  high  lovol  pooplo. 


V 


Tho  conclusion  that  the  itoms  can  bo  answered  correctly  without  recourse^ 
to  tho  paragraphs  is  buttrossod  by  certain  interrelations  in  the  data.  It  was 
shown  that  the  itoms  that  were  most  consistently  answered  by  virtually  all  of 
tho  mon  wore  those  involving  tho  identification  of  a  fact  or  idoa  container  ill 
tho  paragraph,  '.-here  it  was  possible  to  answor  itoms  without  recourse  to  tho 
paragraphs,  it  is  probably  attributable  to  tho  fact  that  the  materia  o  '-*oa_  wi 
matters  of  general  information.  It  is  logical  to  suppose  that  items .  dealing 
diroctly  with  the  facts  would  bo  easiest  to  answor  correctly.  Likowiso,  i:  may 
bo  assumed  that  itoms  doaling  with  facts  which  wore  not  mentioned  in  the  para¬ 
graph  would  bo  suscoptiblo  to  boing  answorod  incorroctly,  particularly  where. one 
of  the  wrong  alternatives  is  a  true  statement.  Tho  results  wore  consistent  in 
supporting  this  reasoning. 


6.  Conclusions. 

1.  There  is  clear  ovidonco  that  a  largo  proportion  of  the  itoms  in  the 
original  untried  form  of  tho  Heading  and  Vocabulary  Tost  can  bo  answorod  eor- 
rectly  without  reading  tho  paragraphs  by  a  significant  proportion  of  men  in  o 
uppor  half  of  tho  range  of  talent. 

2.  Thoro  is  a  docidod  tondoncy  to  answer  corroctly  thoso  types  of  items 
requiring  an  identification  of  a  fact  or  idoas  diroctly  treated  in  the  paragraph. 

3.  Tho  likelihood  of  choosing  a  wrong  answor  for  typos  of  items  involving 
an  identification  of  a  fact  or  idoa  not  statod  in  tho  paragraph  is  greater  than 
for  othor  typos, 

4.  Thoso  findings  should  bo  taken  into  account  in  tho  rovisions  of  tho 
original  tost. 
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